Skip to content

Template argument deduction using SymbolDatabase#8720

Open
pfultz2 wants to merge 16 commits into
cppcheck-opensource:mainfrom
pfultz2:template-deduce-loop
Open

Template argument deduction using SymbolDatabase#8720
pfultz2 wants to merge 16 commits into
cppcheck-opensource:mainfrom
pfultz2:template-deduce-loop

Conversation

@pfultz2

@pfultz2 pfultz2 commented Jul 13, 2026

Copy link
Copy Markdown
Contributor

This creates a loop where we run the TemplateSimplifier -> varids/links/AST/SymbolDatabase/ValueTypes, so on the second round of TemplateSimplifier we can use type information from the SymbolDatabase. Not all the passes need to run with TemplateSimplifer so there is a SymbolDatabase::finalize().

On a naive run, it would delete all the AST/SymbolDatabase information, but this can be kind of slow. So I added some incremental updates by tracking where new tokens are added(plus the function bodies around changed call sites), and then refactoring functions to work on token ranges, so there is now TokenList::createAst(start, end) and in SymbolDatabase: addSymbolsForNewTokenRanges(), updateFunctionAndVariablePointers(), a range-limited setValueTypeInTokenList() and findAllScopes(const Token* startToken, const Token* endToken, Scope* startScope). Also the createSymbolDatabaseFindAllScopes internals were split into reusable per-scope/per-function helpers to support this.

Now this only does incremental updates on function instantiation because its much simpler to do as it only adds a Function, its scope and locals(and the only stale references in old code are the renamed call sites, which updateFunctionAndVariablePointers() re-resolves by name). Instantiating a class introduces new functions and types that could be resolved in other parts of the code. So for this case it does a full rebuild.

Also the template alias simplifications requires a full build as well as it restructures existing tokens throughout the list, not just in new ranges. So the "unchanged tokens keep valid info" premise of the incremental update no longer holds.

We can probably address these in the future but will require a larger refactor. I also added a --template-full-rebuild so we can debug any issue with the incremental updates.

MathLib::value num(arg->str());
if (num.isFloat()) {
// MathLib::getSuffix doesn't work for floating point numbers
const char suffix = arg->str().back();
if (it != parameterCountCache.cend())
return it->second;
const DeductionCandidate parsed = parseDeductionCandidate(candidate);
const int count = parsed.typeParameters.empty() ? -1 : static_cast<int>(parsed.parameterShapes.size());
// matching is not possible yet - the declaration may be in a base class - so
// consider all declarations with this name.
for (auto pos = range.first; pos != range.second; ++pos) {
if (supportedParameterCount(*pos->second) == static_cast<int>(instantiationArgs.size())) {
const TokenAndName* declaration = nullptr;
DeductionCandidate parsedDeclaration;
for (const TokenAndName* candidate : candidates) {
if (supportedParameterCount(*candidate) != static_cast<int>(instantiationArgs.size()))
// "T *": the argument must be a pointer and T is the pointee type
if (pointer < 1)
return DeducedType();
constness &= ~(1U << pointer);

if (pointer > 2)
return DeducedType();
if (constness >= (1U << (pointer + 1)))
case ValueType::UNKNOWN_INT:
// not deducible
return DeducedType();
}
static void insertDeducedType(Token* tok, const DeducedType& deduced)
{
for (int level = deduced.pointer; level >= 1; --level) {
if (deduced.constness & (1U << level))
std::vector<const Token*> declarationParams;
getFunctionArguments(candidate.nameToken(), declarationParams);

std::vector<bool> deducible(parsed.typeParameters.size(), false);
if (argRoots.size() != instantiationArgs.size())
return qualification;
std::vector<DeducedType> deducedTypes(parsedDeclaration.typeParameters.size());
std::vector<bool> deducedSet(parsedDeclaration.typeParameters.size(), false);
@pfultz2

pfultz2 commented Jul 19, 2026

Copy link
Copy Markdown
Contributor Author

So I ran some numbers comparing the time with valueflow disabled:

file branch main delta loop time sdb+finalize (br vs main)
valueflow.cpp 0.584s 0.456s +0.128s (+28%) 0.121s 0.094s vs 0.083s
tokenize.cpp 0.611s 0.525s +0.086s (+16%) 0.088s 0.092s vs 0.096s
symboldatabase.cpp 0.478s 0.402s +0.075s (+19%) 0.101s 0.072s vs 0.077s
checkclass.cpp 0.316s 0.239s +0.077s (+32%) 0.059s 0.044s vs 0.043s
checkother.cpp 0.291s 0.215s +0.076s (+35%) 0.055s 0.041s vs 0.039s
astutils.cpp 0.263s 0.207s +0.055s (+27%) 0.050s 0.037s vs 0.033s
templatesimplifier.cpp 0.249s 0.197s +0.052s (+27%) 0.034s 0.035s vs 0.035s
checkstl.cpp 0.228s 0.187s +0.041s (+22%) 0.044s 0.031s vs 0.030s
vf_analyzers.cpp 0.208s 0.147s +0.061s (+41%) 0.057s 0.019s vs 0.021s
programmemory.cpp 0.194s 0.158s +0.037s (+23%) 0.036s 0.023s vs 0.025s

It seems to be about ~20-30% slower, which is much better than what it was before at ~80% slower doing full rebuilds. Partial rebuilds seem to really help a lot with this.

Obviously since we are doing more instantiations than before it is going to be slower even as there may be room to improve this further. I think this is an acceptable slowdown and in the end I think this will still be faster than the approach in #8688 as we will have to always compute the valuetypes twice since they are seperate components. So I think this approach is ultimately better.

@danmar @chrchr-github What are you thoughts on this approach? I can work on cleaning up this PR and fixing the CI failures if you think this is the better way to go.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants